Image projector device

ABSTRACT

An image projector device includes a projection optical unit through which an image is projected and displayed, a recognition unit that recognizes a user&#39;s action related to processing of the image, and a control unit that generates and/or edits a drawing image based on the user&#39;s action recognized by the recognition unit and projects and displays the drawing image being generated and/or edited as a projected, displayed image through the projection optical unit.

CROSS-REFERENCE TO RELATED APPLICATION

This is a continuation application of application Ser. No. 13/712,294filed Dec. 12, 2012 which claims priority from Japanese applicationsJP2012-105754A filed on May 7, 2012, JP2012-107608A filed on May 9, 2012and JP2012-108558A filed on May 10, 2012, the content of which is herebyincorporated by reference into this application.

BACKGROUND

1. Field of the Invention

The present invention relates to a technology of an image projectordevice.

2. Description of the Related Art

In a conference or a discussion made by a plurality of persons, theparticipants usually create drawings with a pen on a whiteboard tostimulate the discussion. A drawing created on the whiteboard is readwith a camera or a scanner provided as an integrated part of thewhiteboard, and the drawing image is saved by printing it with aprinter, saving the drawing image in a memory, or otherwise processingthe drawing image. In recent years, a drawing capturing capability of acamera, a sensor, or any other device is used with a projector andapplication software having a whiteboard capability is run on a PC(personal computer) to allow the projector to work as a whiteboard aswell (JP-A-2004-239967, for example).

However, to allow a projector to work as a whiteboard as well, it isalways necessary to prepare a PC, which disadvantageously requires timeand effort. Further, when a plurality of persons bring PCs with them andcreate various drawings on the respective PCs, it is necessary to switchthe connection between the projector and the PCs whenever a drawing iscreated on any of the PCs, and application software having a whiteboardcapability needs to be installed in each of the PCs. Moreover, an imageof a drawing created on each of the PCs is saved in the PC used tocreate the drawing, but the image of the drawing created on each of thePCs cannot be so saved that the participants can share the image. Toallow the participants to share an image of a drawing created on each ofthe PCs, drawing data need to be distributed or otherwise undergocumbersome processes. The invention has been made in order to solve theexisting problems described above, and an object of the invention is toachieve a capability required in a conference using a whiteboardcapability by using a projector alone.

SUMMARY

The invention has been made to solve at least a part of the problemsdescribed above, and the invention can be implemented as the followingaspects.

According to an aspect of the invention, an image projector device isprovided. The image projector device includes a projection optical unit,a storage unit, a control unit, and an enclosure that accommodates theprojection optical unit, the storage unit, and the control unit. Theprojection optical unit can project and display an image. The storageunit stores an image in a readable manner. The control unit can projectand display the stored image through the projection optical unit inaccordance with user's selection. According to the thus configured imageprojector device, since a function of storing a projected, displayedimage is provided in the enclosure of the image projector device, it isnot necessary to separately prepare another device that stores an imagein a readable manner.

The image projector device described above may be configured to furtherinclude a recognition unit. The recognition unit can recognize a user'saction related to processing of an image. In this case, the control maygenerate and/or edit a drawing image based on the user's actionrecognized by the recognition unit and project and display an editedimage containing the drawing image being generated and/or edited as aprojected, displayed image through the projection optical unit. Further,the storage unit may store the edited image used as the projected,displayed image.

Alternatively, in the image projector device described above, thecontrol unit may generate and/or edit a drawing image based on theuser's action recognized by the recognition unit, superimpose thedrawing image on a base image that is a background image of the drawingimage to generate an edited image, and project and display the editedimage as a projected, displayed image through the projection opticalunit. Further, the storage unit may store the edited image used as theprojected, displayed image.

According to another aspect of the invention, the image projector devicemay further include an input unit, an image storage unit, and a displaycontrol unit. The input unit may receive an externally inputted image.The image storage unit may store the inputted image. The display controlunit may project and display a displayed image containing the followingareas through the projection optical unit: a candidate image displayarea where the stored one or more images are displayed inuser-selectable forms; and an edited image area where the selected imageis displayed.

All the plurality of elements provided in the aspects of the inventiondescribed above are not essential. To achieve part or all ofadvantageous effects described herein, part of the plurality of elementsdescribed above can be changed, deleted, replaced with new otherelements, and partially deleted in a limited manner as appropriate.Further, to achieve part or all of the advantageous effects describedherein, part or all of the technical features contained in an aspect ofthe invention described above can be combined with part or all of thetechnical features contained in another aspect of the inventiondescribed above to provide an independent aspect of the invention.

The invention can be implemented in a variety of other aspects. Forexample, the invention can be implemented in the form of an electronicblackboard apparatus, an electronic blackboard system, a conferenceapparatus, a conference system, an image projection and display method,an image projection and display program product, and other aspects.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a descriptive diagram for describing the configuration of animage projector system.

FIG. 2 is a block diagram for schematically describing the configurationof a projector.

FIG. 3 is a descriptive diagram for describing the configuration of anoperation panel.

FIG. 4 is a flowchart for describing the procedure of an activationcontrol process.

FIG. 5 is a descriptive diagram showing a WB displayed image.

FIG. 6 is a flowchart showing the procedure of WB mode processes.

FIG. 7 is a flowchart showing the procedure of an edited imagegeneration process.

FIG. 8 is a flowchart showing the procedure of a base image settingprocess.

FIG. 9 is a flowchart showing the procedure of an image storage process.

FIG. 10 is a flowchart showing the procedure of an output controlprocess.

FIG. 11 is a flowchart showing the procedure of an activation controlprocess in a second embodiment.

FIG. 12 is a descriptive diagram showing a WB displayed image in thesecond embodiment.

FIG. 13 is a flowchart showing the procedure of WE mode processes in thesecond embodiment.

FIG. 14 is a flowchart showing the procedure of a base image settingprocess in the second embodiment.

FIG. 15 is a flowchart showing the procedure of an edited imagegeneration process in the second embodiment.

FIG. 16 is a flowchart showing the procedure of an image storage processin the second embodiment.

FIG. 17 is a flowchart showing the procedure of an output controlprocess in the second embodiment.

FIG. 18 is a flowchart showing the procedure of an activation controlprocess in a third embodiment.

FIG. 19 is a descriptive diagram showing a WB displayed image in thethird embodiment.

FIG. 20 is a flowchart showing the procedure of WB mode processes in thethird embodiment.

FIG. 21 is a flowchart showing the procedure of an image input processin the third embodiment.

FIG. 22 is a flowchart showing the procedure of an edited imagegeneration process in the third embodiment.

FIG. 23 is a flowchart showing the procedure of an image storage processin the third embodiment.

FIG. 24 is a flowchart showing the procedure of an output controlprocess in the third embodiment.

DESCRIPTION OF EXEMPLARY EMBODIMENTS A. First Embodiment (A1) SystemConfiguration

FIG. 1 is a descriptive diagram for describing the configuration of animage projector system 10 using a projector 20 as a first embodiment ofthe invention. The image projector system 10 includes the projector 20,an operation panel 70 through which the projector 20 is operated, acomputer PC, a printer PR, and a server SV. The projector 20 and theoperation panel 70 are connected to each other with a dedicated cableCV. The printer PR is connected to the projector 20 via the operationpanel 70. Further, a flash memory MR as an external storage device isconnected to the operation panel 70. The projector 20 receives data fromthe flash memory MR and outputs data to the flash memory MR via theoperation panel 70. Each of the computer PC and the server SV isconnected to the projector 20 via a wireless LAN (not shown). The serverSV is connected to the Internet INT or any other external network, andthe projector 20 can be connected to INT via the server SV.

The projector 20 is a wall-mounted, short-focal-length projector andprojects and displays an image on a screen SCR installed in a shortdistance from the projector 20. An image projected and displayed by theprojector 20 is hereinafter also referred to as a displayed image. Theprojector 20 has a capability of a typical projector that projects anddisplays externally inputted motion images or still images as displayedimages. The action mode of the projector 20 that performs the typicalcapability is hereinafter also referred to as a normal mode (NML mode).Further, the projector 20 has a capability of what is called anelectronic blackboard that recognizes a drawing action performed by auser on the screen SCR, and the projector 20 then projects and displaysa drawing image corresponding to the drawing action as a displayed imageon the screen SCR. The action mode of the projector 20 that performs theelectronic blackboard capability is hereinafter referred to as awhiteboard mode (WE mode). The projector 20 acting in the WB mode uses acamera 54, which will be described later, to recognize an actionperformed on the screen SCR (hereinafter also referred to as drawingaction) by the user who uses a pen emitting infrared light from the tipthereof (hereinafter also referred to as infrared light pen P) andprojects and displays a drawing image corresponding to the drawingaction on the screen SCR.

FIG. 2 is a block diagram for schematically describing the configurationof the projector 20. The projector 20 includes a CPU 22, an EEPROM 42, aRAM 45, a ROM 46, an operation unit 48, an input interface (input IF)50, an output interface (output IF) 52, a camera 54, a projectionoptical unit 56, and a body-side connection interface (body-sideconnection IF) 58. The elements described above are connected to eachother via a bus 21.

The CPU 22, which controls the action of the entire projector 20,includes a drawing recognition unit 24, a drawing image generation unit26, an edited image generation unit 28, a tool control unit 30, an imageinput processing unit 32, a displayed image control unit 38, an imagestorage processing unit 39, an output control unit 40, and an activationcontrol unit 41. Further, the image input processing unit 32 includes astill image acquisition unit 34 and a frame image acquisition unit 36.The functional units described above provided in the CPU 22 are achievedby the CPU 22 that reads a program stored in the ROM 46 and executes theprogram. The functional units will be described later in detail.

The EEPROM 42 includes an image storage unit 44 and stores an image asrequired when the CPU 22 acts as any of the functional units describedabove. The operation unit 48 includes operation mechanisms used when theuser operates the projector 20, such as a switch that powers theprojector 20 on and off and a switch that switches an input source toanother.

The input IF 50 includes a plurality of input mechanisms through whichimage data outputted from the following devices are inputted: a motionimage data reproduction device MV (DVD, for example), the flash memoryMR, a digital camera CM, a scanner SCN, the server SV, the computer PC,and other data output devices. The output IF 52 includes a plurality ofother output mechanisms through which image data are outputted towardthe flash memory MR, the printer PR, the server SV, and other datareception devices including data reception mechanisms. The input IF 50and the output IF 52 are shown as separate elements for ease ofdescription, but a single connection interface capable of sending andreceiving data in a bidirectional manner, such as a USB terminal and aLAN connection terminal, functions as both the input IF 50 and theoutput IF 52. The connection of the input IF 50 and the output IF 52with the computer PC, the server SV, and other devices is not limited towired connection but may be wireless connection. The wireless connectioncan be established based on wireless LAN, Bluetooth®, infraredcommunication, and other wireless communication technologies.

The camera 54 captures images of the screen SCR and a portion in thevicinity thereof at predetermined intervals to sense the infrared lightemitted from the infrared light pen P used by the user to perform adrawing action. Based on the path of the sensed infrared light, the CPU22 acquires coordinate information by using the function of the drawingrecognition unit 24 and generates a drawing image corresponding to thedrawing action by using the function of the drawing image generationunit 26. Alternatively, a dedicated board that functions as the screenSCR may be used to recognize a user's drawing action. Specifically, adedicated board having a touch panel capability may be connected to theprojector 20, and the drawing recognition unit 24 may acquire coordinateinformation corresponding to a drawing action performed by the user onthe dedicated board. The drawing image generation unit 26 may thengenerate a drawing image based on the acquired coordinate information.

The projection optical unit 56 includes a light source, a lightseparator that separates light from the source light into RGB lightsources, a liquid crystal panel that modulates light fluxes from the RGBlight sources to form an image to be displayed, and a plurality oflenses that focus the light fluxes modulated by the liquid crystal panelon the screen SCR to form the displayed image (none of the elementsdescribed above is shown). A digital micro-mirror device (DMD) mayalternatively be used as the mechanism that modulates the light fluxesfrom the RGB light sources.

The body-side connection IF 58 is a connection interface used to connectthe projector 20 to the operation panel 70. The operation panel 70includes the cable CV and a panel-side connection IF 71 used to connectthe operation panel 70 to the projector 20. When the body-sideconnection IF 58 and the panel-side connection IF 71 are connected toeach other, the projector 20 and the operation panel 70 are connected toeach other for data transmission and reception.

FIG. 3 is a descriptive diagram for describing the configuration of theoperation panel 70. The operation panel 70 includes the panel-sideconnection IF 71, the cable CV, a connection terminal 72, a connectionterminal 73, an input IF 74, an output IF 75, an NML mode activationbutton 76, a WB mode activation button 78, an input source detectionbutton 80, a capture button 82, a print button 84, and a save button 86.The panel-side connection IF 71 is a connector to be connected to thebody-side connection IF 58 of the projector 20, as described above. Theconnection terminal 72 and the connection terminal 73 are connectorsthat allow the cable CV to be attached to and detached from the body ofthe operation panel 70. The separable connection configuration betweenthe body-side connection IF 58 and the panel-side connection IF 71 orbetween the connection terminal 72 and the connection terminal 73 allowsthe user to carry the operation panel 70 separately from the projector20.

The input IF 74 has the same function as that of the input IF 50, whichhas been described with reference to FIG. 2. Similarly, the output IF 75has the same function as that of the output IF 52 (FIG. 2). Datainputted via the input IF 74 and data outputted via the output IF 75 arereceived from and sent to the projector 20 via the cable CV and thepanel-side connection IF 71. The NML mode activation button 76 is abutton used to activate the projector 20, and the projector 20 startsthe NML mode when sensing that the NML mode activation button 76 isturned “ON.” The WB mode activation button 78 is also a button used toactivate the projector 20, and the projector 20 starts the WB mode whensensing that the WB mode activation button 78 is turned “ON.” The usercan power off the projector 20 by operating the NML mode activationbutton 76 to turn “OFF” the power either in the case where the NML modehas started or the case where the WB mode has started.

The input source detection button 80 is an operation button thatinstructs the projector 20 to carry out a process of searching for adata source (input source) that can be inputted from a data outputdevice connected to the input IF 50 and the output IF 74. The capturebutton 82 is an operation button used when the projector 20 acquiresmotion image data from the motion image data reproduction device MV andprojects and displays motion images to acquire a single-frame stillimage from the motion images. The print button 84 is an operation buttonthat instructs the printer PR to print a displayed image being projectedand displayed or an image stored in the image storage unit 44. The savebutton 86 is an operation button used to save a displayed image beingprojected and displayed as image data. When the user operates any of theoperation buttons, a signal corresponding to the operation is inputtedto the projector 20 via the cable CV and the panel-side connection IF71. The CPU 22 in the projector 20 then acts in accordance with thereceived signal.

(A2) Action of Projector 20

The action of the projector 20 will next be described. FIG. 4 is aflowchart for describing the procedure of an activation control processcarried out by the CPU 22 as the function of the activation control unit41 when the user operates the NML mode activation button 76 or the WBmode activation button 78 to activate the projector 20. The activationcontrol process is initiated when the user operates the NML modeactivation button 76 or the WB mode activation button 78. After theactivation control process is initiated, the CPU 22 determines whetherthe activation button that the user has operated is the NML modeactivation button 76 or the WB mode activation button 78 (step S1102).When the activation button that the user has operated is the NML modeactivation button 76 (step S1102: NML), the CPU 22 accesses devicesconnected to the input IF 50 or the input IF 74 one by one and searchesfor an input source (step S1104). When an input source is detected as aresult of the search (step S1104: YES), the CPU 22 starts the NML mode(step S1106) and then terminates the activation control process.

When the projector 20 is activated in the NML mode, the CPU 22 generatesan image to be displayed based on data inputted from the detected inputsource and projects and displays the image on the screen SCR. On theother hand, when the button that the user has operated is the WB modeactivation button 78 in step S1102 (step S1102: WB) or no input sourceis detected in step S1104 (step S1104: NO), the CPU 22 starts the WBmode (step S1108) and then terminates the activation control process.

The action of the projector 20 in the WB mode will next be described.FIG. 5 is a descriptive diagram showing a displayed image projected anddisplayed by the projector 20 on the screen SCR when the projector 20 isactivated in the WB mode (hereinafter also referred to as WB displayedimage DSP1). General action of the projector 20 in the WE mode will bedescribed with reference to FIG. 5, and then processes carried out inthe WB mode will be described in detail with reference to a flowchart.The WB displayed image DSP1 is formed of an edited image area EDF1, amaterial image display area MTF1, a drawn image area RSF1, and a tooldisplay area TLF1, as shown in FIG. 5.

The edited image area EDF1 is an area where an image being drawn oredited by the user (hereinafter also referred to as edited image) isdisplayed. When the user performs a drawing action with the infraredlight pen P on the edited image area EDF1 projected and displayed on thescreen SCR, the CPU 22 carries out an edited image generation process,which will be described later, and displays a drawing imagecorresponding to the drawing action in the edited image area EDF1. Whenthe WB mode starts, a white-colored image (white image) is displayed asa background image in the edited image area EDF1. When the user has setno other image in the edited image area EDF1, the projector 20superimposes the drawing image on the white edited image area EDF1. Thebackground image displayed in the edited image area EDF1 is hereinafteralso referred to as a “base image.” A base image is not necessarily awhite image and can be a black image, a yellow image, an externallyacquired graphic image or photographic image, or any other arbitraryimage.

The material image display area MTF1 is an area where material imagesthat are externally acquired and can be used as part of the edited imageare displayed in the form of thumbnails. When the user who is performingdrawing or editing selects one of the material images displayed in theform of thumbnails in the material image display area MTF1 with theinfrared light pen P, the material image corresponding to the selectedthumbnail is inserted in the edited image area EDF1. The user can usethe inserted material image as part of the edited image.

The drawn image area RSF1 is an area where images having been drawn andedited by the user (hereinafter also referred to as drawn images) andsaved in the image storage unit 44 are displayed in the form ofthumbnails. When the user selects a thumbnail image from those displayedin the drawn image area RSF1 with the infrared light pen P, the drawnimage corresponding to the selected thumbnail image is displayed in theedited image area EDF1 and the user is allowed to edit the edited imageagain.

The tool display area TLF1 is an area where icons corresponding to editfunctions (hereinafter also referred to as tools) used by the user whois performing drawing and editing are displayed in the user-selectableforms. Examples of the displayed icons representing tools are asfollows: an icon that allows the user to select the type of line drawingthat forms a drawing image, such as “pen” and “brush”; an icon thatallows the user to select the color of a line drawing; icons thatrepresent figures stored in advance in the image storage unit 44 and canbe inserted in an edited image, such as a circle, a triangle, and arectangle; an icon that represents an eraser function for deleting aline drawing created in a drawing action; and icons that represent toolsprovided by typical application software having drawing and editingcapabilities.

Further, the following icons representing tools are displayed in thetool display area TLF1: a mail transmission icon representing a functionof transmitting an edited image attached to a mail message; a save iconrepresenting a function of storing an edited image displayed in theedited image area EDF1 in the image storage unit 44; an external storageicon representing a function of storing an edited image in an externalstorage device connected to the projector 20; and a print iconrepresenting a function of printing an edited image. When the user whois performing drawing or editing selects one of the variety of iconsdisplayed in the tool display area TLF1 with the infrared light pen P,the tool function corresponding to the selected icon is activated.

Processes carried out by the CPU 22 in the WB mode (hereinafter referredto as WE mode processes) will next be described with reference to aflowchart. FIG. 6 is a flowchart showing the procedure of the WB modeprocesses carried out by the CPU 22. The WB mode processes are initiatedwhen the WB mode starts (step S1108 in FIG. 4) in the activation controlprocess (FIG. 4). When the CPU 22 initiates the WE mode, the WBdisplayed image DSP1 (FIG. 5) is projected and displayed on the screenSCR via the projection optical unit 56 (step S112). Having started theWB mode, the CPU 22 sets a white image as the base image in the editedimage area EDF1 in the WB displayed image DSP1, as described above.Images used as the base image are stored in the image storage unit 44,and the CPU 22 reads one of the images from the image storage unit 44and sets the read image in the edited image area EDF1.

The CPU 22 then carries out an edited image generation process as thefunction of the edited image generation unit 28 (step S1120). The editedimage generation process is a process in which the CPU 22 generates anedited image based on drawing and editing actions performed by the userby using the infrared light pen P on the edited image area EDF1 in theWB displayed image DSP1 having been projected and displayed. The editedimage generation process will be described later in detail.

After the edited image generation process, the CPU 22 generates an imageto be displayed based on the generated edited image (step S1152).Specifically, the CPU 22 generates a WE displayed image DSP1 in whichthe generated edited image is displayed in the edited image area EDF1.The CPU 22 then uses the generated WB displayed image DSP1 as an imageto be displayed. Having generated the image to be displayed, the CPU 22projects and displays the generated image to be displayed on the screenSCR (step S1154).

Thereafter, when the user operates the save button 86 (see FIG. 3) orthe save icon as a tool (step S1156: YES), the CPU 22 carries out animage storage process as the function of the image storage processingunit 39 (step S1160). The image storage process will be described later.

Further, when the user operates the print button 84, or the mailtransmission icon or the external storage icon as tools (step S1165:YES), the CPU 22 carries out an output control process of outputtingdata out of the projector 20 as the function of the output control unit40 (step S1170). The output control process will be described later.

The CPU 22 repeatedly carries out the processes in steps S1120 to S1170until the user operates the NML mode activation button 76 to power offthe projector (step S1192: NO). When the user operates the NML modeactivation button 76 to power off the projector (step S1192: YES), theCPU 22 checks whether or not the edited image being edited and displayedin the edited image area EDF1 has been saved in step S1156 (step S1194).When the edited image being edited has not been saved (step S1194: NO),the CPU 22 stores the edited image in a re-editable format in the imagestorage unit 44 (step S1196). The CPU 22 then powers off the projector20 (step S1198) and terminates the WE mode process.

The edited image generation process (step S1120 in FIG. 6) carried outby the CPU 22 will next be described. FIG. 7 is a flowchart showing theprocedure of the edited image generation process carried out by the CPU22. Having initiated the edited image generation process, the CPU 22checks if the user has specified the base image (step S1121). Specifyingthe base image means that the user specifies an input source containingan image to be displayed in the edited image area EDF1 among inputsource devices connected to the projector via the input IF 50 or theinput IF 74. When the user has not specified the base image (step S1121:NO), the CPU 22 sets a white image as the base image.

On the other hand, when the user has specified the base image (stepS1121: YES), the CPU 22 carries out a base image setting process (stepS1130). The base image setting process is a process of acquiring animage from the input source specified by the user among the input sourcedevices connected to the projector via the input IF 50 or the input IF74 and setting the acquired image to be the base image. The base imagesetting process will be described later in detail.

After the base image is set, the camera 54 detects the infrared lightemitted from the infrared light pen P and the CPU 22 determines whetheror not the user is performing a drawing action (step S1124) based on aresult of the detection. When the CPU 22 determines that the user isperforming a drawing action (step S1124: YES), the CPU 22 recognizes thedrawing action being performed by the user (step S1125). Specifically,the CPU 22 controls the camera 54 to capture images of the screen SCRand a portion in the vicinity thereof at predetermined intervals. TheCPU 22 recognizes the path of the infrared light emitted from theinfrared light pen P based on the captured images and converts therecognized path into coordinate data.

Having recognized the drawing action, the CPU 22 generates a drawingimage as the function of the drawing image generation unit 26 based onthe recognized drawing action (step S1126). Specifically, a line drawingis created based on the coordinate data produced from the path of theinfrared light emitted from the infrared light pen P. In this process,when the user has selected a predetermined tool function in advance, aline drawing according to the tool function is created. For example,when the brush has been selected as the type of line drawing and red hasbeen selected as the color of the line drawing, the CPU 22 generates adrawing image formed of a red line drawing drawn with the brush as thefunction of the tool control unit 30. Having generated the drawingimage, the CPU 22 superimposes the drawing image on the base imagehaving been set (step S1127).

The CPU 22 then checks whether or not the user has inserted a materialimage in the edited image (step S1128). Specifically, the CPU 22 checksif the user has selected a material from those displayed in the form ofthumbnails in the material image display area MTF1 with the infraredlight pen. P. When the user has selected a material image (step S1128:YES), the CPU 22 reads the material image selected by the user from thematerial images stored in the image storage unit 44 in advance andsuperimposes the material image on the image generated in the processesthrough step S128 (image generated by superimposing drawing image onbase image when “YES” in step S1124, whereas base image when “NO” instep S1124) to generate an edited image (step S1129). The CPU 22 thenterminates the edited image generation process.

On the other hand, when the user has selected no material image (stepS1129: NO), the CPU 22 sets the image generated in the processes throughstep S128 to be an edited image and terminates the edited imagegeneration process. It is noted that the material images stored in theimage storage unit 44 are images acquired by the CPU 22 in advance froman input source connected to the projector via the input IF 50 or theinput IF 74 in order to use the images as material images and stored bythe CPU 22 in the image storage unit 44. The CPU 22 stores the materialimages in the image storage unit 44 in response to a user's instruction.The CPU 22 thus carries out the edited image generation process.

The base image setting process (step S1130 in FIG. 7) will next bedescribed. FIG. 8 is a flowchart showing the procedure of the base imagesetting process carried out by the CPU 22. Having initiated the baseimage setting process, the CPU 22 accesses the input source specified bythe user and refers to image-containing data stored in the input source(step S1131). Specifically, when the user operates the input sourcedetection button 80, the CPU 22 accesses the input IF 50 and the inputIF 74 one by one to detect devices connected to each of the input IFs.Input sources in the present embodiment are the following devices shownin FIG. 2: the motion image data reproduction device MV; the flashmemory MR; the digital camera CM; the scanner SCN; the computer PC; andthe Internet connected to the projector via the server SV. The imagestorage unit 44, which stores a variety of images in advance, may alsobe an input source. Having detected input sources, the CPU 22 projectsand displays the connected input sources (devices) in the form ofuser-selectable displayed images (dialog box, for example). The userselects a desired input source from the projected and displayed inputsources with the infrared light pen P. The CPU 22 accesses the inputsource (device) specified by the user and refers to data stored in thespecified input source.

Having referred to the specified input source, the CPU 22 checks whetherthe data in the specified input source is a still image or motion images(step S1132). When the data in the specified input source is a stillimage (step S1132: YES), the CPU 22 sets the still image in thespecified input source to be the base image (step S1133) and terminatesthe base image setting process.

On the other hand, in step S1132, when the data in the specified inputsource are motion images (step S1132: NO), the motion images in thespecified input source are reproduced, that is, projected and displayed(step S1134). The motion images may be reproduced and displayed in theedited image area EDF1 or as displayed images dedicated for motion imagereproduction. In the present embodiment, the motion images arereproduced and displayed as displayed images dedicated for motion imagereproduction.

When the user operates the capture button 82 (step S1135: YES) while themotion images are reproduced and displayed, the CPU 22 acquires a frameimage in one of the motion images being reproduced and displayed, thatis, a frame image in the motion image projected and displayed when theuser operates the capture button 82, and stores the acquired frame imagein the image storage unit 44 (step S1136). Having acquired the frameimage, the CPU 22 sets the acquired frame image to be the base image(step S1137) and terminates the base image setting process. Having thuscarried out the base image setting process, the CPU 22 carries out theprocesses in step S1124 and the following steps in the edited imagegeneration process (FIG. 7).

The image storage process (step S1160 in FIG. 6) will next be described.FIG. 9 is a flowchart showing the procedure of the image storage processcarried out by the CPU 22. Having initiated the image storage process,the CPU 22 converts the edited image into data expressed in a dataformat specified by the user (hereinafter also referred to as specifiedformat) (step S1161). The user specifies the data format, after the useroperates the save button 86 and the CPU 22 projects and displays severaldata formats in the form of user-selectable displayed images, byselecting a desired data format with the infrared light pen P. Examplesof the user-selectable data formats include PNG, PDF, JPEG, and a uniqueformat re-editable by the projector 20 (hereinafter also referred to asunique format). A variety of data formats other than those describedabove may be employed. The user selects a data format from thosedescribed above. Having converted the edited image into data expressedin the specified format, the CPU 22 saves the data in the image storageunit 44 (step S1162) and terminates the image storage process.

The output control process (step S1170 in FIG. 6) will next bedescribed. FIG. 10 is a flowchart showing the procedure of the outputcontrol process carried out by the CPU 22 as the function of the outputcontrol unit 40. Having initiated the output control process, the CPU 22carries out a process according to user's operation of the print button84 or the print icon, or the external storage icon or the mailtransmission icon displayed in the tool display area TLF1 (step S1171).

When the user operates the print button 84 or the print icon (stepS1171: PRINT), the CPU 22 converts the edited image into print data(step S1172). Specifically, the CPU 22 has a printer driver capabilityas the function of the output control unit 40 and converts the editedimage into print data that can be printed with the printer PR connectedto the projector 20. The printer driver relevant to the printer PRconnected to the projector 20 may be provided as the function of theoutput control unit 40 in advance, may be acquired from the printer PRwhen the printer PR is connected to the projector, or may be acquiredfrom a source external to the projector 20, for example, from anexternal storage device or over a LAN.

Having converted the edited image into print data, the CPU 22 outputsthe print data to the printer PR (step S1173). The printing devicereceives the print data from the projector 20 and carries out a printprocess. The above description has been made with reference to the casewhere an edited image being edited is printed, but the projector 20 canalternatively read a drawn image stored in the image storage unit 44 inthe image storage process (FIG. 9) and print the drawn image.Specifically, when the user selects a drawn image from those displayedin the form of thumbnails in the drawn image area RSF1 with the infraredlight pen P, the CPU 22 reads the selected drawn image from the imagestorage unit 44 and displays the image in the edited image area EDF1.Thereafter, when the user operates the print button 84, the CPU 22carries out the processes in steps S1172 and S1173 described above toprint the image.

Additionally, when converting the edited image into print data, the CPU22 may perform the data conversion in such a way that the base image andthe drawing image can be visually distinguished from each other in aprinted image produced in the print process. The base image and thedrawing image can be visually distinguished from each other, forexample, by drawing the contour of a line drawing that forms the drawingimage with a broken line or a white line, coloring the drawing imagewith a single specific color, increasing or decreasing the chroma orbrightness of the base image as compared with that of the drawing image,or using a variety of other methods.

Further, when converting the edited image into print data, the CPU 22may list drawing images in a printed image produced in the print processin chronological order of user's drawing actions. To this end, the CPU22 stores each generated drawing image and the time when the drawingimage is generated in the EEPROM 42 with the drawing image and thegenerated time related to each other, and when the edited image isconverted into the print data, the CPU 22 generates print data thatlists the drawing images based on the time when they are generated. TheCPU 22 can carry out the print process based on the edited image in thevariety of methods described above. Printed images are useful for theuser who wants to review what was discussed in a conference along timeseries.

When the user operates the external storage icon (step S1171: EXTERNALSTORAGE), the CPU 22 converts the generated edited image into dataexpressed in a format specified by the user (step S1174). The userspecifies the data format, after the user operates the external storageicon and the CPU 22 projects and displays data formats in the form ofuser-selectable displayed images, by selecting a desired data formatwith the infrared light pen P. Examples of the user-selectable dataformats include PNG, PDF, JPEG, and a unique format. A variety of dataformats other than those described above may be employed.

Having converted the edited image into data expressed in the specifiedformat, the CPU 22 outputs the converted data to the flash memory MRconnected to the output IF 52 or the output IF 75 (step S1175). Theflash memory MR receives the data outputted from the projector 20 andrecords the data. After the user selects a specified format, the CPU 22projects and displays a dialog box as a displayed image and the user canselect an area in the flash memory MR where the data is saved.Alternatively, a default save area may be set in advance.

Further, the projector 20 can read a saved edited image stored in theimage storage unit 44 in the image storage process (FIG. 9) and recordthe image in the flash memory MR. Specifically, the user reads a savededited image displayed in the form of a thumbnail in the drawn imagearea RSF1 with the infrared light pen P and places the image in theedited image area EDF1, and the user then operates the external storageicon to instruct the CPU 22 to carry out the processes in steps S1174and S1175 described above to record the image. Alternatively, a savededited image displayed in the form of a thumbnail in the drawn imagearea RSF1 may not be read into the edited image area EDF1 but may beoutputted directly to the flash memory MR. To this end, the user selectsa thumbnail displayed image corresponding to a saved edited image thatthe user desires to store in the flash memory MR, and then the useroperates the external storage icon to instruct the CPU 22 to output theselected saved edited image to the flash memory MR.

On the other hand, when the user operates the mail transmission icon(step S1171: MAIL TRANSMISSION), the CPU 22 converts the generatededited image into data expressed in a format specified by the user (stepS1176), as in step S1174. The data on the edited image having undergonethe data conversion is attached to a mail message (step S1177), and themail message is transmitted via the server SV (step S1178).

Specifically, the CPU 22 has a mailer function as the function of theoutput control unit 40 and can attach the data on the edited image to amail message and transmit the mail message. Mail addresses used astransmission destinations are displayed in the form of user-selectabledisplayed images after mail address data expressed in a specific dataformat (vCard®, for example) are externally acquired over a LAN or viathe flash memory MR and the mailer is activated. The user selects adesired mail address with the infrared light pen P from one or more mailaddresses displayed in the form of displayed images. An edited imageattached to a mail message is not limited to the edited image beingedited and may alternatively be an image specified by the user fromsaved edited images (drawn images) displayed in the form of thumbnailsin the drawn image area RSF1. In this case, the CPU 22 reads the drawnimage specified by the user in the drawn image area RSF1 from the imagestorage unit 44, converts the read image into data expressed in thespecified format, and attaches the data to the mail message. The CPU 22thus carries out the output control process.

As described above, the projector 20 according to the present embodimentis capable of recognizing a drawing action, generating and editing adrawing image, and storing an edited image. The user can therefore usethe projector 20 as a whiteboard suitable in a conference without havingto separately prepare a device having the functions described above(computer PC, for example) but with a relatively simple effort. Further,the projector 20 can store an edited image projected onto the screen SCRas it is in the image storage unit 44 and read back the stored drawnimage. The user can therefore use the edited image recorded in theprojector 20 as a minute in which what was discussed is recorded.Further, since the projector 20 can print and output the edited image,store the edited image in an external storage device, and transmit theedited image attached to a mail message, the user can save anddistribute in a variety of methods the edited image as it is afterhaving been drawn and edited. That is, the edited image recorded in theprojector 20 can be shared by a plurality of users in a variety offorms.

The projector 20 can use an externally acquired still image or a frameimage in externally acquired motion images as the base image. Further,the projector 20 can use an externally acquired still image or a frameimage in externally acquired motion images as a material image. Theprojector 20 therefore allows a user's desired image to be projected anddisplayed, the user to create a drawing on the desired image, the userto draw and edit an edited image by using an externally acquired imageas part of the edited image without separately preparing the computer PChaving the functions described above.

The projector 20, which carries out the activation control process shownin FIG. 4, allows the user to use the WB mode immediately after simpleoperation. Further, the projector 20, which automatically stores anedited image in the image storage unit 44 when the user has not savedthe edited image before the user powers off the projector, can hold theedited image even when the user forgets saving the edited image andpowers off the projector. The projector 20, which can be operatedthrough the operation panel 70, can be readily operated even when theprojector 20 is a wall-mounted projector as shown in FIG. 1.

B. Second Embodiment Action of Projector 20 in Second Embodiment

A second embodiment of the invention will next be described. The secondembodiment differs from the first embodiment in terms of the action ofthe projector 20. The system configuration in the second embodiment isthe same as that in the first embodiment, and no description thereofwill therefore be made. The action of the projector 20 according to thesecond embodiment will be described below. FIG. 11 is a flowchart fordescribing the procedure of an activation control process carried out bythe CPU 22 as the function of the activation control unit 41 when theuser operates the NML mode activation button 76 or the WE modeactivation button 78 to activate the projector 20. The activationcontrol process is initiated when the user operates the NML modeactivation button 76 or the WB mode activation button 78. After theactivation control process is initiated, the CPU 22 determines whetherthe activation button that the user has operated is the NML modeactivation button 76 or the WB mode activation button 78 (step S2102).When the activation button that the user has operated is the NML modeactivation button 76 (step S2102: NML), the CPU 22 accesses devicesconnected to the input IF 50 or the input IF 74 one by one and searchesfor an input source (step S2104). When an input source is detected as aresult of the search (step S2104: YES), the CPU 22 starts the NML mode(step S2106) and then terminates the activation control process.

When the projector 20 is activated in the NML mode, the CPU 22 generatesan image to be displayed based on data inputted from the detected inputsource and projects and displays the image on the screen SCR. On theother hand, when the button that the user has operated is the WB modeactivation button 78 in step S2102 (step S2102: WB), or when no inputsource is detected in step S2104 (step S2104: NO), the CPU 22 starts theWB mode (step S2108) and terminates the activation control process.

The action of the projector 20 in the WB mode will next be described.FIG. 12 is a descriptive diagram showing an image to be displayed thatthe projector 20 projects and displays on the screen SCR (hereinafteralso referred to as WB displayed image DSP2) when the projector 20 isactivated in the WB mode. General action of the projector 20 in the WBmode will be described with reference to FIG. 12, and then processescarried out in the WB mode will be described in detail with reference toa flowchart. The WB displayed image DSP2 is formed of an edited imagearea EDF2, a material image display area MTF2, a drawn image area RSF2,and a tool display area TLF2, as shown in FIG. 12.

The edited image area EDF2 is an area where a desired image that theuser projects and displays on the screen SCR (hereinafter also referredto as base image), such as an image and a photograph for presentation,is displayed. The user can perform drawing and edit actions on the baseimage displayed in the edited image area EDF2 with the infrared lightpen P. When the user performs drawing and editing, an image thatreflects the drawing and editing (hereinafter also referred to as editedimage) is displayed in the edited image area EDF2 in real time.

The material image display area MTF2 is an area where material imagesthat are externally acquired and can be used as part of the edited imageare displayed in the form of thumbnails. When the user who is performingdrawing or editing selects one of the material images displayed in theform of thumbnails in the material image display area MTF2 with theinfrared light pen P, the material image corresponding to the selectedthumbnail is inserted in the edited image area EDF2. The user can usethe inserted material image as part of the edited image.

The drawn image area RSF2 is an area where images having been drawn andedited by the user (hereinafter also referred to as drawn images) andsaved in the image storage unit 44 are displayed in the form ofthumbnails. When the user selects a thumbnail image from those displayedin the drawn image area RSF2 with the infrared light pen P, the drawnimage corresponding to the selected thumbnail image is displayed in theedited image area EDF2 and the user is allowed to edit the edited imageagain.

The tool display area TLF2 is an area where icons corresponding to editfunctions (hereinafter also referred to as tools) used by the user whois performing drawing and editing are displayed in the user-selectableforms. Examples of the displayed icons representing tools are asfollows: an icon that allows the user to select the type of line drawingthat forms a drawing image, such as “pen” and “brush”; an icon thatallows the user to select the color of a line drawing; icons thatrepresents figures that are stored in advance in the image storage unit44 and can be inserted in an edited image, such as a circle, a triangle,and a rectangle; an icon that represents an eraser function for deletinga line drawing created in a drawing action; and icons that representtools provided by typical application software having drawing andediting capabilities.

Further, the following icons representing tools are displayed in thetool display area TLF2: a base image setting icon representing afunction of setting a base image to be displayed in the edited imagearea EDF2; a mail transmission icon representing a function oftransmitting an edited image attached to a mail message; a save iconrepresenting a function of storing an edited image displayed in theedited image area EDF2 in the image storage unit 44; an external storageicon representing a function of storing an edited image in an externalstorage device connected to the projector 20; and a print iconrepresenting a function of printing an edited image. When the user whois performing drawing or editing selects any of the variety of iconsdisplayed in the tool display area TLF2 with the infrared light pen P,the tool function corresponding to the selected icon is activated.

Processes carried out by the CPU 22 in the WB mode (hereinafter referredto as WB mode processes) will next be described with reference to aflowchart. FIG. 13 is a flowchart showing the procedure of the WE modeprocesses carried out by the CPU 22. The WB mode processes are initiatedwhen the WB mode starts (step S2108 in FIG. 11) in the activationcontrol process (FIG. 11). Having initiated the WB mode, the CPU 22carries out a base image setting process (step S2110). The base imagesetting process is a process of acquiring an image from the input sourcespecified by the user among the input source devices connected to theprojector via the input IF 50 or the input IF 74 and setting theacquired image to be the base image. In the base image setting process,the WB displayed image DSP2, in which the base image set by the user isdisplayed in the edited image area EDF2, is projected and displayed as adisplayed image on the screen SCR. The base image setting process willbe described later in detail.

After the base image setting process, the CPU 22 carries out an editedimage generation process (step S2130) as the function of the editedimage generation unit 28. The edited image generation process is aprocess in which the CPU 22 generates an edited image based on drawingand editing actions performed by the user by using the infrared lightpen P on the edited image area EDF2 in the WB displayed image DSP2having been projected and displayed. The edited image generation processwill be described later in detail.

After the edited image generation process, the CPU 22 generates an imageto be displayed based on the generated edited image (step S2152).Specifically, the CPU 22 generates a WB displayed image DSP2 in whichthe generated edited image is displayed in the edited image area EDF2.The CPU 22 then uses the generated WB displayed image DSP2 as an imageto be displayed. Having generated the image to be displayed, the CPU 22projects and displays the generated image to be displayed on the screenSCR (step S2154).

Thereafter, when the user operates the base image setting icon to setthe base image again (step S2155: YES), the CPU 22 repeats the processesdescribed above from step S2110. When the user does not operate the baseimage setting icon (step S2155: NO), the CPU 22 proceeds to the processin step 2156.

Thereafter, when the user operates the save button 86 (see FIG. 3) orthe save icon as a tool (step S2156: YES), the CPU 22 carries out animage storage process (step S2160) as the function of the image storageprocessing unit 39. The image storage process will be described later.

Further, when the user operates the print button 84, or the mailtransmission icon or the external storage icon as tools (step S2165:YES), the CPU 22 carries out an output control process of outputtingdata out of the projector 20 as the function of the output control unit40 (step S2170). The output control process will be described later.

The CPU 22 repeatedly carries out the processes in steps S2130 to S2170until the user operates the NML mode activation button 76 to power offthe projector (step S2192: NO). When the user operates the NML modeactivation button 76 to power off the projector (step S2192: YES), theCPU 22 checks whether or not the edited image being edited and displayedin the edited image area EDF2 has been saved in step S2156 (step S2194).When the edited image being edited has not been saved (step S2194: NO),the CPU 22 stores the edited image in a re-editable format in the imagestorage unit 44 (step S2196). The CPU 22 then powers off the projector20 (step S2198) and terminates the WB mode processes.

The base image setting process (step S2110 in FIG. 13) will next bedescribed. FIG. 14 is a flowchart showing the procedure of the baseimage setting process carried out by the CPU 22. Having initiated thebase image setting process, the CPU 22 accesses the input sourcespecified by the user and refers to image-containing data stored in theinput source (step S2112). Specifically, when the user operates theinput source detection button 80, the CPU 22 accesses the input IF 50and the input IF 74 one by one to detect devices connected to each ofthe input IFs. Input sources in the present embodiment are the followingdevices shown in FIG. 2: the motion image data reproduction device MV;the flash memory MR; the digital camera CM; the scanner SCN; thecomputer PC; and websites on the Internet connected to the projector viathe server SV. The image storage unit 44, which stores a variety ofimages in advance, may also be an input source. Having detected inputsources, the CPU 22 projects and displays the connected input sources(devices) in the form of user-selectable displayed images (dialog box,for example). The user selects a desired input source from the projectedand displayed input sources with the infrared light pen P. The CPU 22accesses the input source (device) specified by the user and refers todata stored in the specified input source.

Having referred to the specified input source, the CPU 22 checks whetherthe data in the specified input source is a still image or motion images(step S2114). When the data in the specified input source is a stillimage (step S2114: YES), the CPU 22 sets the still image in thespecified input source to be the base image as the function of the stillimage acquisition unit 34 (step S2116). The CPU 22 then projects anddisplays a WB displayed image DSP2 in which the thus set base image isdisplayed as a displayed image in the edited image area EDF2 (stepS2117). The CPU 22 then terminates the base image setting process.

On the other hand, in step S2114, when the data in the specified inputsource are motion images (step S2114: NO), the motion images in thespecified input source are reproduced, that is, projected and displayed(step S2118). The motion images may be reproduced and displayed in theedited image area EDF2 or as displayed images dedicated for motion imagereproduction. In the present embodiment, the motion images arereproduced and displayed as displayed images dedicated for motion imagereproduction.

When the user operates the capture button 82 while the motion images arereproduced and displayed (step S2120: YES), the CPU 22 acquires a frameimage in one of the motion images being reproduced and displayed, thatis, a frame image in the motion image projected and displayed when theuser operates the capture button 82, and stores the acquired frame imagein the image storage unit 44 (step S2122) as the function of the frameimage acquisition unit 36. When the user does not operate the capturebutton 82 while the motion images are reproduced (step S2120: NO), theCPU 22 repeatedly reproduces the motion images. Alternatively, a firstimage of the motion images may be acquired as the frame image. Havingacquired the frame image, the CPU 22 sets the acquired frame image to bethe base image (step S2124). The CPU 22 then projects and displays a WBdisplayed image DSP2 in which the thus set base image is displayed inthe edited image area EDF2 as a displayed image (step S2117) andterminates the base image setting process.

The edited image generation process (step S2130 in FIG. 13) carried outby the CPU 22 will next be described. FIG. 15 is a flowchart showing theprocedure of the edited image generation process carried out by the CPU22. Having started the edited image generation process, the camera 54detects the infrared light emitted from the infrared light pen P, andthe CPU 22 determines whether or not the user is performing a drawingaction on the edited image area EDF2 on the screen SCR based on a resultof the detection (step S2132). When the CPU 22 determines that the useris performing a drawing action (step S2132: YES), the CPU 22 recognizesthe drawing action being performed by the user (step S2134).Specifically, the CPU 22 controls the camera 54 to capture images of thescreen SCR and a portion in the vicinity thereof at predeterminedintervals. Based on the captured image, the CPU 22 recognizes the pathof the infrared light emitted from the infrared light pen P and convertsthe recognized path into coordinate data.

Having recognized the drawing action, the CPU 22 generates a drawingimage based on the recognized drawing action as the function of thedrawing image generation unit 26 (step S2136). Specifically, a linedrawing is created based on the coordinate data produced from the pathof the infrared light emitted from the infrared light pen P. In thisprocess, when the user has selected a predetermined tool function inadvance, a line drawing according to the tool function is created. Forexample, when the brush has been selected as the type of line drawingand red has been selected as the color of the line drawing, the CPU 22generates a drawing image formed of a red line drawing drawn with thebrush as the function of the tool control unit 30. Having generated thedrawing image, the CPU 22 superimposes the drawing image on the baseimage having been set (step S2138).

The CPU 22 then checks whether or not the user has inserted a materialimage in the edited image (step S2140). Specifically, the CPU 22 checksif the user has selected a material from those displayed in the form ofthumbnails in the material image display area MTF2 with the infraredlight pen P. When the user has selected a material image (step S2140:YES), the CPU 22 reads the material image selected by the user from thematerial images stored in the image storage unit 44 in advance andsuperimposes the material image on the image generated in the processesthrough step 2140 (image generated by superimposing drawing image onbase image when “YES” in step S2132, whereas base image when “NO” instep S2132) to generate an edited image (step S142). The CPU 22 thenterminates the edited image generation process.

On the other hand, when the user has selected no material image (stepS2140: NO), the CPU 22 sets the image generated in the processes throughstep S2140 to be an edited image and terminates the edited imagegeneration process. It is noted that the material images stored in theimage storage unit 44 are images acquired by the CPU 22 in advance froman input source connected to the projector via the input IF 50 or theinput IF 74 in order to use the images as material images and stored bythe CPU 22 in the image storage unit 44. The CPU 22 stores the materialimages in response to a user's instruction. The CPU 22 thus carries outthe edited image generation process.

The image storage process (step S2160 in FIG. 13) will next bedescribed. FIG. 16 is a flowchart showing the procedure of the imagestorage process carried out by the CPU 22. Having initiated the imagestorage process, the CPU 22 converts the edited image into dataexpressed in a data format specified by the user (hereinafter alsoreferred to as specified format) (step S2161). The user specifies thedata format, after the user operates the save button 86 and the CPU 22projects and displays several data formats in the form ofuser-selectable displayed images, by selecting a desired data formatwith the infrared light pen P. Examples of the user-selectable dataformats include PNG, PDF, JPEG, and a unique format re-editable by theprojector 20 (hereinafter also referred to as unique format). A varietyof data formats other than those described above may be employed. Theuser selects a data format from those described above. Having convertedthe edited image into data in the specified format, the CPU 22 saves thedata in the image storage unit 44 (step S2162) and terminates the imagestorage process.

The output control process (step S2170 in FIG. 13) will next bedescribed. FIG. 17 is a flowchart showing the procedure of the outputcontrol process carried out by the CPU 22 as the function of the outputcontrol unit 40. Having initiated the output control process, the CPU 22carries out a process according to user's operation of the print button84 or the print icon, or the external storage icon or the mailtransmission icon displayed in the tool display area TLF2 (step S2171).

When the user operates the print button 84 or the print icon (stepS2171: PRINT), the CPU 22 converts the edited image into print data(step S2172). Specifically, the CPU 22 has a printer driver capabilityas the function of the output control unit 40 and converts the editedimage into print data that can be printed with the printer PR connectedto the projector 20. The printer driver relevant to the printer PRconnected to the projector 20 may be provided as the function of theoutput control unit 40 in advance, may be acquired from the printer PRwhen the printer PR is connected to the projector, or may be acquiredfrom a source external to the projector 2, for example, from an externalstorage device or over a LAN.

Having converted the edited image into print data, the CPU 22 outputsthe print data to the printer PR (step S2173). The printing devicereceives the print data from the projector 20 and carries out a printprocess. The above description has been made with reference to the casewhere an edited image being edited is printed, but the projector 20 canalternatively read a drawn image stored in the image storage unit 44 inthe image storage process (FIG. 16) and print the drawn image.Specifically, when the user selects a drawn image from those displayedin the form of thumbnails in the drawn image area RSF2 with the infraredlight pen P, the CPU 22 reads the selected drawn image from the imagestorage unit 44 and displays the image in the edited image area EDF2.Thereafter, when the user operates the print button 84, the CPU 22carries out the processes in steps S2172 and S2173 described above toprint the image.

Additionally, when converting the edited image into print data, the CPU22 may perform the data conversion in such a way that the base image andthe drawing image can be visually distinguished from each other in aprinted image produced in the print process. The base image and thedrawing image can be visually distinguished from each other, forexample, by drawing the contour of a line drawing that forms the drawingimage with a broken line or a white line, coloring the drawing imagewith a single specific color, increasing or decreasing the chroma orbrightness of the base image as compared with that of the drawing image,or using a variety of other methods.

Further, when converting the edited image into print data, the CPU 22may list drawing images in a printed image produced in the print processin chronological order of user's drawing actions. To this end, the CPU22 stores each generated drawing image and the time when the drawingimage is generated in the EEPROM 42 with the drawing image and thegenerated time related to each other, and when the edited image isconverted into the print data, the CPU 22 generates print data thatlists the drawing images based on the time when they are generated. TheCPU 22 can carry out the print process based on the edited image in thevariety of methods described above. Printed images are useful for theuser who wants to review what was discussed in a conference along timeseries.

When the user operates the external storage icon (step S2171: EXTERNALSTORAGE), the CPU 22 converts the generated edited image into dataexpressed in a format specified by the user (step S2174). The userspecifies the data format, after the user operates the external storageicon and the CPU 22 projects and displays data formats in the form ofuser-selectable displayed images, by selecting a desired data formatwith the infrared light pen P. Examples of the user-selectable dataformats include PNG, PDF, JPEG, and a unique format. A variety of dataformats other than those described above may be employed.

Having converted the edited image into data expressed in the specifiedformat, the CPU 22 outputs the converted data to the flash memory MRconnected to the output IF 52 or the output IF 75 (step S2175). Theflash memory MR receives the data outputted from the projector 20 andrecords the data. After the user selects a specified format, the CPU 22projects and displays a dialog box as a displayed image and the user canselect an area in the flash memory MR where the data is saved.Alternatively, a default save area may be set in advance.

Further, the projector 20 can read a saved edited image stored in theimage storage unit 44 in the image storage process (FIG. 16) and recordthe image in the flash memory MR. Specifically, the user reads a savededited image displayed in the form of a thumbnail in the drawn imagearea RSF2 with the infrared light pen P and places the image in theedited image area EDF2, and the user then operates the external storageicon to instruct the CPU 22 to carry out the processes in steps S2174and S2175 described above to record the image. Alternatively, a savededited image displayed in the form of a thumbnail in the drawn imagearea RSF2 may not be read into the edited image area EDF2 but may beoutputted directly to the flash memory MR. To this end, the user selectsa thumbnail displayed image corresponding to a saved edited image thatthe user desires to store in the flash memory MR, and then the useroperates the external storage icon to instruct the CPU 22 to output theselected saved edited image to the flash memory MR.

On the other hand, when the user operates the mail transmission icon(step S2171: MAIL TRANSMISSION), the CPU 22 converts the generatededited image into data expressed in a format specified by the user (stepS2176), as in step S2174. The data on the edited image having undergonethe data conversion is attached to a mail message (step S2177), and themail message is transmitted via the server SV (step S2178).

Specifically, the CPU 22 has a mailer function as the function of theoutput control unit 40 and can attach the data on the edited image to amail message and transmit the mail message. Mail addresses used astransmission destinations are displayed in the form of user-selectabledisplayed images after mail address data expressed in a specific dataformat (vCard®, for example) are externally acquired over a LAN or viathe flash memory MR and the mailer is activated. The user selects adesired mail address with the infrared light pen P from one or more mailaddresses displayed in the form of displayed images. An edited imageattached to a mail message is not limited to the edited image beingedited and may alternatively be an image specified by the user fromsaved edited images (drawn images) displayed in the form of thumbnailsin the drawn image area RSF2. In this case, the CPU 22 reads the drawnimage specified by the user in the drawn image area RSF2 from the imagestorage unit 44, converts the read image into data expressed in thespecified format, and attaches the data to the mail message. The CPU 22thus carries out the output control process.

As described above, when the user performs drawing and editing actionson a projected, displayed base image, the projector 20 according to thepresent embodiment can recognize the drawing and the editing actions,produce and edit a drawing image, generate an edited image by using thebase image as a background image, and project and display the editedimage in real time. Further, the projector 20 can store the editedimage. The user can therefore use the projector 20 as a whiteboardsuitable in a conference without having to separately prepare a devicehaving the functions described above (computer PC, for example) but witha relatively simple effort.

Further, the projector 20 can store an edited image projected onto thescreen SCR as it is in the image storage unit 44 and read back thestored drawn image. The user can therefore use the edited image recordedin the projector 20 as a minute in which what was discussed is recorded.Further, since the projector 20 can print and output the edited image,store the edited image in an external storage device, and transmit theedited image attached to a mail message, the user can store anddistribute in a variety of methods the edited image as it is afterhaving been drawn and edited. That is, the edited image recorded in theprojector 20 can be shared by a plurality of users in a variety offorms.

The projector 20 can use an externally acquired still image or a frameimage in externally acquired motion images as the base image. Further,the projector 20 can use an externally acquired still image or a frameimage in externally acquired motion images as a material image. Theprojector 20 therefore allows a users desired image to be projected anddisplayed, the user to create a drawing on the desired image, the userto draw and edit an edited image by using an externally acquired imageas part of the edited image without separately preparing the computer PChaving the functions described above.

The projector 20, which carries out the activation control process shownin FIG. 11, allows the user to use the WB mode immediately after simpleoperation. Further, the projector 20, which automatically stores anedited image in the image storage unit 44 when the user has not savedthe edited image before the user powers off the projector, can hold theedited image even when the user forgets saving the edited image andpowers off the projector. The projector 20, which can be operatedthrough the operation panel 70, can be readily operated even when theprojector 20 is a wall-mounted projector as shown in FIG. 1.

C. Third Embodiment Action of Projector 20 in Third Embodiment

A third embodiment of the invention will next be described. The thirdembodiment differs from the first embodiment in terms of the action ofthe projector 20. The system configuration in the third embodiment isthe same as that in the first embodiment, and no description thereofwill therefore be made. The action of the projector 20 according to thethird embodiment will next be described. FIG. 18 is a flowchart fordescribing the procedure of an activation control process carried out bythe CPU 22 as the function of the activation control unit 41 when theuser operates the NML mode activation button 76 or the WB modeactivation button 78 to activate the projector 20. The activationcontrol process is initiated when the user operates the NML modeactivation button 76 or the WB mode activation button 78. After theactivation control process is initiated, the CPU 22 determines whetherthe activation button that the user has operated is the NML modeactivation button 76 or the WB mode activation button 78 (step S3102).When the activation button that the user has operated is the NML modeactivation button 76 (step S3102: NML), the CPU 22 accesses devicesconnected to the input IF 50 or the input IF 74 one by one and searchfor an input source (step S3104). When an input source is detected as aresult of the search (step S3104: YES), the CPU 22 starts the NML mode(step S3106) and then terminates the activation control process.

When the projector 20 is activated in the NML mode, the CPU 22 generatesan image to be displayed based on data inputted from the detected inputsource and projects and displays the image on the screen SCR. On theother hand, when the button that the user has operated in step S3102 isthe WB mode activation button 78 (step S3102: WB), or when no inputsource is detected in step S3104 (step S3104: NO), the CPU 22 starts theWB mode (step S3108) and terminates the activation control process.

The action of the projector 20 in the WB mode will next be described.FIG. 19 is a descriptive diagram showing an image to be displayed thatthe projector 20 projects and displays on the screen SCR (hereinafteralso referred to as WB displayed image DSP3) when the projector 20 isactivated in the WB mode. General action of the projector 20 in the WEmode will be described with reference to FIG. 19, and then processescarried out in the WB mode will be described in detail with reference toa flowchart. The WB displayed image DSP3 is formed of an edited imagearea EDF3, a candidate image area SLF3, a drawn image area RSF3, and atool display area TLF3, as shown in FIG. 19.

The edited image area EDF3 is an area where a desired image that theuser projects and displays on the screen SCR, such as an image and aphotograph for presentation, is displayed. An image displayed in theedited image area EDF3 is hereinafter also referred to as a base image.The user can perform drawing and editing actions on the base imagedisplayed in the edited image area EDF3 with the infrared light pen P.Drawing and editing actions are hereinafter referred to as editing in abroad sense. After the user performs editing, an image that reflects theediting (hereinafter also referred to as edited image) is displayed inthe edited image area EDF3 in real time.

The candidate image area SLF3 is an area where images externallyacquired via the input IF 50 or the input IF 74 and stored in the imagestorage unit 44 (hereinafter also referred to as candidate images) aredisplayed in the form of thumbnails. When the user who is performingdrawing or editing selects one of the candidate images displayed in theform of thumbnails in the candidate image area SLF3 with the infraredlight pen P, the candidate image corresponding to the selected thumbnailis displayed as the base image in the edited image area EDF3.

The drawn image area RSF3 is an area where images having been drawn andedited by the user (hereinafter also referred to as drawn images) andsaved in the image storage unit 44 are displayed in the form ofthumbnails. When the user selects a drawn image from those displayed inthe form of thumbnails in the drawn image area RSF3 with the infraredlight pen P, the drawn image corresponding to the selected thumbnail isdisplayed in the edited image area EDF3 and the user is allowed to editthe edited image again.

The tool display area TLF3 is an area where icons corresponding to editfunctions (hereinafter also referred to as tools) used by the user whois performing drawing and editing are displayed in the user-selectableforms. Examples of the displayed icons representing tools are asfollows: an icon that allows the user to select the type of line drawingthat forms a drawing image, such as “pen” and “brush”; an icon thatallows the user to select the color of a line drawing; icons thatrepresent figures stored in the image storage unit 44 in advance and canbe inserted in an edited image, such as a circle, a triangle, and arectangle; an icon that represents an eraser function for deleting aline drawing created in a drawing action; and icons that represent toolsprovided by typical application software having drawing and editingcapabilities.

Further, the following icons representing tools are displayed in thetool display area TLF3: an image input icon representing a function ofexternally inputting an image; a mail transmission icon representing afunction of transmitting an edited image attached to a mail message; asave icon representing a function of storing an edited image displayedin the edited image area EDF3 in the image storage unit 44; an externalstorage icon representing a function of storing an edited image in anexternal storage device connected to the projector 20; and a print iconrepresenting a function of printing an edited image. When the user whois performing drawing or editing selects any of the variety of iconsdisplayed in the tool display area TLF3 with the infrared light pen P,the tool function corresponding to the selected icon is activated.

Processes carried out by the CPU 22 in the WB mode (hereinafter referredto as WB mode processes) will next be described with reference to aflowchart. FIG. 20 is a flowchart showing the procedure of the WE modeprocesses carried out by the CPU 22. The WB mode processes are initiatedwhen the WB mode is activated (step S3108 in FIG. 18) in the activationcontrol process (FIG. 18). Having initiated the WE mode, the CPU 22projects and displays a WB displayed image DSP3 in which a white-coloredimage (white image) is set as the base image in the edited image areaEDF3 (step S3112). The CPU 22 then checks if the user has operated theimage input icon (step S3114). When the user has operated the imageinput icon (step S3114: YES), the CPU 22 carries out an image inputprocess (step S3120). The image input process is a process of acquiringan image from a data output device connected to the projector 20 via theinput IF 50 or the input IF 74 and storing the acquired image in theimage storage unit 44. The image stored in the image storage unit 44 inthe image input process can be used as the base image displayed in theedited image area EDF3. The image input process will be described laterin detail.

On the other hand, when the user has not operated the image input icon(step S3114; NO), or after the image input process (step S3120) iscompleted, the CPU 22 carries out an edited image generation process(step S3130) as the function of the edited image generation unit 28. Theedited image generation process is a process in which the CPU 22generates an edited image based on drawing and editing actions performedby the user by using the infrared light pen P on the edited image areaEDF3 in the WB displayed image DSP3 having been projected and displayed.The edited image generation process will be described later in detail.

After the edited image generation process, the CPU 22 generates an imageto be displayed based on the generated edited image (step S3152).Specifically, the CPU 22 generates a WB displayed image DSP3 in whichthe generated edited image is displayed in the edited image area EDF3.The CPU 22 then uses the generated WB displayed image DSP3 as an imageto be displayed. Having generated the image to be displayed, the CPU 22projects and displays the generated image to be displayed on the screenSCR (step S3154).

Thereafter, when the user operates the save button 86 (see FIG. 3) orthe save icon as a tool (step S3156: YES), the CPU 22 carries out animage storage process (step S3160) as the function of the image storageprocessing unit 39. The image storage process will be described later.

Further, when the user operates the print button 84, or the mailtransmission icon or the external storage icon as tools (step S3165:YES), the CPU 22 carries out an output control process of outputtingdata out of the projector 20 as the function of the output control unit40 (step S3170). The output control process will be described later.

The CPU 22 repeatedly carries out the processes in steps S3114 to S3170until the user operates the NML mode activation button 76 to power offthe projector (step S3192: NO). When the user operates the NML modeactivation button 76 to power off the projector (step S3192: YES), theCPU 22 checks whether or not the edited image being edited and displayedin the edited image area EDF3 has been saved in step S3156 (step S3194).When the edited image being edited has not been saved (step S3194: NO),the CPU 22 stores the edited image in a re-editable format in the imagestorage unit 44 (step S3196). The CPU 22 then powers off the projector20 (step S3198) and terminates the WB mode processes.

The image input process (step S3120 in FIG. 20) will next be described.FIG. 21 is a flowchart showing the procedure of the image input processcarried out by the CPU 22. The image input process is a process ofacquiring a desired image to be set as the base image by the user from adata output device (input source) connected to the projector via theinput IF 50 or the input IF 74.

The image input process is initiated when the user operates the imageinput icon (step S3114 in FIG. 20: YES). Having initiated the imageinput process, the CPU 22 accesses an input source specified by the userand refers to image-containing data stored in the input source (stepS3121 in FIG. 21). Specifically, when the user operates the image inputicon, the CPU 22 accesses the input IF 50 and the input IF 74 one by oneto detect devices connected to each of the input IFs. Input sources inthe present embodiment are the following devices shown in FIG. 2: themotion image data reproduction device MV; the flash memory MR; thedigital camera CM; the scanner SCN; the computer PC; and websites on theInternet connected to the projector via the server SV. Having detectedinput sources, the CPU 22 projects and displays the connected inputsources (devices) in the form of user-selectable displayed images(dialog box, for example). The user selects a desired input source andimage data from the projected and displayed input sources with theinfrared light pen P. The CPU 22 accesses the input source (device)specified by the user and refers to data stored in the specified inputsource.

Having referred to the specified input source, the CPU 22 checks whetherthe data in the specified input source is a still image or motion images(step S3122). When the data in the specified input source is a stillimage (step S3122: YES), the CPU 22 reads the still image in thespecified input source and stores the still image in the image storageunit 44 as the function of the still image acquisition unit 34 (stepS3123). An image stored in the image storage unit 44 in the image inputprocess is hereinafter also referred to as a candidate image. The CPU 22then generates a thumbnail image of the candidate image stored in theimage storage unit 44 and displays the image in the form of a thumbnailin the candidate image area SLF3 (step S3128).

On the other hand, when the data in the specified input source aremotion images (step S3122: NO), the motion images in the specified inputsource are reproduced, that is, projected and displayed (step S3124).The motion images may be reproduced and displayed in the edited imagearea EDF3 or as displayed images dedicated for motion imagereproduction. In the present embodiment, the motion images arereproduced and displayed as displayed images dedicated for motion imagereproduction.

When the user operates the capture button 82 while the motion images arereproduced and displayed (step S3125: YES), the CPU 22 acquires a frameimage in one of the motion images being reproduced and displayed, thatis, a frame image in the motion image projected and displayed when theuser operates the capture button 82 (step S3126) as the function of theframe image acquisition unit 36. When the user does not operate thecapture button 82 while the motion images are being reproduced (stepS3125: NO), the CPU 22 repeatedly reproduces the motion images.Alternatively, a first image of the motion images may be acquired as theframe image.

Having acquired the frame image, the CPU 22 stores the acquired frameimage as a candidate image in the image storage unit 44 (step S3127).The CPU 22 then generates a thumbnail image of the candidate imagestored in the image storage unit 44 and displays the thumbnail image inthe form of a thumbnail in the candidate image area SLF3 (step S3128).The CPU 22 repeatedly carries out the processes in steps S3121 to S3128until the user terminates the image input process (step S3129: NO). Thatis, when the user inputs a plurality of images as candidate images tothe projector 20, the CPU 22 repeatedly carries out the processes insteps S3121 to S3128. In the present embodiment, the CPU 22 displays animage input process termination icon in the form of a displayed image atthe same time when the image input process is initiated, and when theuser operates the image input process termination icon, the CPU 22terminates the image input process (step S3129: YES). In the presentembodiment, a still image and a frame image acquired in the image inputprocess are directly stored in the image storage unit 44, but theseimage may alternatively be temporarily stored in the RAM 45 and thenstored in the image storage unit 44.

The edited image generation process (step S3130 in FIG. 20) carried outby the CPU 22 will next be described. FIG. 22 is a flowchart showing theprocedure of the edited image generation process carried out by the CPU22. Having initiated the edited image generation process, the CPU 22checks whether or not the user has selected a candidate image from thosedisplayed in the form of thumbnails in the candidate image area SLF3 ora drawn image from those displayed in the form of thumbnails in thedrawn image area RSF3 with the infrared light pen P (image selectionoperation) (step S3132). The drawn images displayed in the form ofthumbnails in the drawn image area RSF3 will be described in thedescription of an image storage process, which will be made later.

When the user has performed the image selection operation (step S3132:YES), and the selected image is a candidate image displayed in thecandidate image area SLF3 (step S3134: CANDIDATE IMAGE), the CPU 22reads the selected candidate image from the image storage unit 44 andsets the image to be the base image (step S3136). On the other hand,when the image selected by the user is a drawn image displayed in thedrawn image area RSF3 (step S3134: DRAWN IMAGE), the CPU 22 reads theselected drawn image from the image storage unit 44 and sets the imageto be the base image (step S3138). Further, when the user has notperformed the image selection operation in step S3132 (step S3132: NO),the base image keeps being the white image set in step S3112 (FIG. 20).

The camera 54 then detects the infrared light emitted from the infraredlight pen P, and the CPU 22 determines based on a result of thedetection whether or not the user is performing a drawing action on theedited image area EDF3 on the screen SCR (step S3140). When the CPU 22determines that the user is performing a drawing action (step S3140:YES), the CPU 22 recognizes the drawing action being performed by theuser (step S3142). Specifically, the CPU 22 controls the camera 54 tocapture images of the screen SCR and a portion in the vicinity thereofat predetermined intervals. Based on the captured image, the CPU 22recognizes the path of the infrared light emitted from the infraredlight pen P and converts the recognized path into coordinate data.

Having recognized the drawing action, the CPU 22 generates a drawingimage based on the recognized drawing action as the function of thedrawing image generation unit 26 (step S3144). Specifically, a linedrawing is created based on the coordinate data produced from the pathof the infrared light emitted from the infrared light pen P. In thisprocess, when the user has selected a predetermined tool function inadvance, a line drawing according to the tool function is created. Forexample, when the brush has been selected as the type of line drawingand red has been selected as the color of the line drawing, the CPU 22generates a drawing image formed of a red line drawing drawn with thebrush as the function of the tool control unit 30. Having generated thedrawing image, the CPU 22 superimposes the drawing image on the baseimage having been set (step S3146) to generate an edited image (stepS3148). On the other hand, when the user has performed no drawing actionin step S3140 (step S3140: NO), the CPU 22 handles the base image havingbeen set as en edited image (step S3148). Having thus generated theedited image, the CPU 22 terminates the edited image generation process.

The image storage process (step S3160 in FIG. 20) will next bedescribed. FIG. 23 is a flowchart showing the procedure of the imagestorage process carried out by the CPU 22. Having initiated the imagestorage process, the CPU 22 converts the edited image into dataexpressed in a data format specified by the user (hereinafter alsoreferred to as specified format) (step S3161). The user specifies thedata format, after the user operates the save button 86 and the CPU 22projects and displays several data formats in the form ofuser-selectable displayed images, by selecting a desired data formatwith the infrared light pen P. Examples of the user-selectable dataformats include PNG, PDF, JPEG, and a unique format re-editable by theprojector 20 (hereinafter also referred to as unique format). A varietyof data formats other than those described above may be employed. Theuser selects a data format from those described above. Having convertedthe edited image into data in the specified format, the CPU 22 saves thedata as a drawn image in the image storage unit 44 (step S3162). The CPU22 then displays the drawn image stored in the image storage unit 44 inthe form of a thumbnail in the drawn image area RFS3 (step S3163) andterminates the image storage process.

The output control process (step S3170 in FIG. 20) will next bedescribed. FIG. 24 is a flowchart showing the procedure of the outputcontrol process carried out by the CPU 22 as the function of the outputcontrol unit 40. Having initiated the output control process, the CPU 22carries out a process according to user's operation of the print button84 or the print icon, or the external storage icon or the mailtransmission icon displayed in the tool display area TLF3 (step S3171).

When the user operates the print button 84 or the print icon (stepS3171: PRINT), the CPU 22 converts the edited image into print data(step S3172). Specifically, the CPU 22 has a printer driver capabilityas the function of the output control unit 40 and converts the editedimage into print data that can be printed with the printer PR connectedto the projector 20. The printer driver relevant to the printer PRconnected to the projector 20 may be provided as the function of theoutput control unit 40 in advance, may be acquired from the printer PRwhen the printer PR is connected to the projector 20, or may be acquiredfrom a source external to the projector 20, for example, from anexternal storage device or over a LAN.

Having converted the edited image into print data, the CPU 22 outputsthe print data to the printer PR (step S3173). The printing devicereceives the print data from the projector 20 and carries out a printprocess. The above description has been made with reference to the casewhere an edited image being edited is printed, but the projector 20 canalternatively read a candidate image or a drawn image stored in theimage storage unit 44 in the image input process (FIG. 21) or the imagestorage process (FIG. 23) and print the candidate image or the drawnimage. Specifically, when the user selects a candidate image or a drawnimage from those displayed in the form of thumbnails in the candidateimage area SLF3 or the drawn image area RSF3 with the infrared light penP, the CPU 22 reads the candidate image or the drawn image from theimage storage unit 44 and displays the image in the edited image areaEDF3. Thereafter, when the user operates the print button 84, the CPU 22carries out the processes in steps S3172 and S3173 to print the image.

Alternatively, when converting the edited image into print data, the CPU22 may perform the data conversion in such a way that the base image andthe drawing image can be visually distinguished from each other in aprinted image produced in the print process. The base image and thedrawing image can be visually distinguished from each other, forexample, by drawing the contour of a line drawing that forms the drawingimage with a broken line or a white line, coloring the drawing imagewith a single specific color, increasing or decreasing the chroma orbrightness of the base image as compared with that of the drawing image,or using a variety of other methods.

Further, when converting the edited image into print data, the CPU 22may list drawing images in a printed image produced in the print processin chronological order of user's drawing actions. To this end, the CPU22 stores each generated drawing image and the time when the drawingimage is generated in the EEPROM 42 with the drawing image and thegenerated time related to each other, and when the edited image isconverted into the print data, the CPU 22 generates print data thatlists the drawing images based on the time when they are generated. TheCPU 22 can carry out the print process based on the edited image in thevariety of methods described above. Printed images are useful for theuser who wants to review what was discussed in a conference along timeseries.

When the user operates the external storage icon (step S3171: EXTERNALSTORAGE), the CPU 22 converts the generated edited image into dataexpressed in a format specified by the user (step S3174). The userspecifies the data format, after the user operates the external storageicon and the CPU 22 projects and displays data formats in the form ofuser-selectable displayed images (dialog box, for example), by selectinga desired data format with the infrared light pen P. Examples of theuser-selectable data formats include PNG, PDF, JPEG, and a uniqueformat. A variety of data formats other than those described above maybe employed.

Having converted the edited image into data expressed in the specifiedformat, the CPU 22 outputs the converted data to the flash memory MRconnected to the output IF 52 or the output IF 75 (step S3175). Theflash memory MR receives the data outputted from the projector 20 andrecords the data. After the user selects a specified format, the CPU 22projects and displays a dialog box as a displayed image and the user canselect an area in the flash memory MR where the data is saved.Alternatively, a default save area may be set in advance.

Further, the projector 20 can read a candidate image or a drawn imagestored in the image storage unit 44 in the image input process (FIG. 21)or the image storage process (FIG. 23) and record the read image in theflash memory MR. Specifically, the user uses the infrared light pen P toselect a candidate image or a drawn image displayed in the form of athumbnail in the candidate image area SLF3 or the drawn image area RSF3and reads the image in the edited image area EDF3, and when the useroperates the external storage icon, the CPU 22 carries out the processesin steps S3174 and S3175 described above to record the image.

Alternatively, a candidate image or a drawn image displayed in the formof a thumbnail in the candidate image area SLF3 or the drawn image areaRSF3 may not be read into the edited image area EDF3 but may beoutputted directly to the flash memory MR. In this case, the userselects one or more thumbnail displayed images corresponding tocandidate images or drawn images that the user desires to store in theflash memory MR, and then the user operates the external storage icon toinstruct the CPU 22 to read the selected candidate images or the drawnimages, convert the read images into data expressed in a formatspecified by the user, and output the data to the flash memory MR. Thepurpose described above can thus be achieved by carrying out the processdescribed above.

On the other hand, when the user operates the mail transmission icon(step S3171: MAIL TRANSMISSION), the CPU 22 converts the generatededited image into data expressed in a format specified by the user (stepS3176), as in step S3174. The data on the edited data having undergonethe data conversion is attached to a mail message (step S3177), and themail message is transmitted via the server SV (step S3178).

Specifically, the CPU 22 has a mailer function as the function of theoutput control unit 40 and can attach the data on the edited image to amail message and transmit the mail message. Mail addresses used astransmission destinations are displayed in the form of user-selectabledisplayed images after mail address data expressed in a specific dataformat (vCard®, for example) are externally acquired over a LAN or viathe flash memory MR and a mailer is activated. The user selects adesired mail address with the infrared light pen P from one or more mailaddresses displayed in the form of displayed images. An edited imageattached to a mail message is not limited to the edited image beingedited and may alternatively be an image specified by the user from thecandidate images or the drawn images displayed in the form of thumbnailsin the candidate image area SLF3 or the drawn image area RSF3. To thisend, the CPU 22 reads the candidate image or the drawn image specifiedby the user in the candidate image area SLF3 or the drawn image areaRSF3 from the image storage unit 44, converts the read image into dataexpressed in the specified format, and attaches the data to the mailmessage. The CPU 22 thus carries out the output control process.

As described above, the projector 20 according to the present embodimentis capable of externally inputting an image and storing the image in theimage storage unit 44. Further, an image selected by the user from thosestored in the image storage unit 44 can be displayed in the edited imagearea EDF3. Therefore, when image data brought by a plurality of users onan individual basis are projected and displayed for presentation, it isnot necessary to switch an input source to another whenever an imageprojected and displayed is switched to another, combine all the imagedata into a single input source (computer PC, for example) before theimage data are projected and displayed, or make any other cumbersomeefforts. Further, the projector 20 can use an externally acquired stillimage or a frame image in externally acquired motion images as the baseimage, whereby it is not necessary to separately prepare the computer PChaving the functions described above.

The projector 20 according to the present embodiment is capable ofrecognizing drawing and editing actions performed by the user on aprojected, displayed base image, producing and editing a drawing image,generating an edited image by using the base image as a backgroundimage, and projecting and displaying the edited image in real time. Theprojector 20 is further capable of storing the edited image. Theprojector 20 is still further capable of directly outputting an imagestored in the image storage unit 44 in the form of a printed image,image data, and an attachment to a mail message. An edited imagegenerated by the user by using the projector 20 as a whiteboard cantherefore be stored as it is in the image storage unit 44, and thestored edited image can be not only read, projected, and displayed butalso distributed by carrying out the output control process. That is, anedited image recorded in the projector 20 can be shared by a pluralityof users in a variety of forms. As a result, the user can use the storededited image as a minute in which what was discussed is recorded.Further, the user can use the projector 20 as a whiteboard suitable in aconference without having to separately prepare a device having thefunctions described above (computer PC, for example) but with arelatively simple effort.

The projector 20, which carries out the activation control process shownin FIG. 18, allows the user to use the WB mode immediately after simpleoperation. Further, the projector 20, which automatically stores anedited image in the image storage unit 44 when the user has not savedthe edited image before the user powers off the projector, can hold theedited image even when the user forgets saving the edited image andpowers off the projector. The projector 20, which can be operatedthrough the operation panel 70, can be readily operated even when theprojector 20 is a wall-mounted projector as shown in FIG. 1.

D. Variations

The invention is not limited to the embodiments described above but canbe implemented in a variety of other aspects to the extent that they donot depart from the substance of the invention. For example, thefollowing variations are conceivable.

(D1) Variation 1

In the embodiments described above, the projector 20 and the operationpanel 70 are wired to each other. Alternatively, they may be wirelesslyconnected to each other by using a wireless LAN, Bluetooth, or any otherwireless technology. Further, a predetermined authentication method maybe used before the connection between the projector 20 and the operationpanel 70 is established. For example, when the projector 20 and theoperation panel 70 are wired to each other, the body-side connection IF58 and the panel-side connection IF 71 or the connection terminal 72 andthe connection terminal 73 have a unique shape on a set basis, and theconnection is established only when the paired components have the sameshape. That is, the projector 20 that belongs to a certain set is notconnected to the operation panel 70 that belongs to another set.

When the projector 20 and the operation panel 70 are wirelesslyconnected to each other, the body-side connection IF 58 and thepanel-side connection IF 71 are configured to communicate with eachother by using a unique signal on a set basis. That is, the body-sideconnection IF 58 that belongs to a certain set and the panel-sideconnection IF 71 that belongs to another set cannot communicate witheach other or practically connected to each other.

Additionally, to connect the operation panel 70 to the projector 20 andestablish communication with each other, a variety of authenticationmethods can be employed as follows: input of a secret number;fingerprint authentication; RFID-card-based authentication; andkey-based authentication. The authentication methods described above canbe practically implemented by providing a numeric keypad through which asecret number is inputted, a fingerprint authentication device, an RFRDreader, a key box, and other functional units according to theauthentication methods provided in the operation panel 70 or theprojector 20. Alternatively, the user may input a secret number into aprojected, displayed numeric keypad image with the infrared light pen P.

Employing any of the configurations described above prevents a user whouses an operation panel that belongs to a projector of a certain modelfrom operating another projector of the same model. For example, whenthe projector 20 has an edited image stored therein, and a rightful userof the projector 20 removes the operation panel 70 from the projector 20and keeps the operation panel 70, another person cannot acquire theedited image recorded in the projector 20 by using an operation panel 70different from the operation panel 70 paired with the projector 20. Theedited image is thus securely stored.

(D2) Variation 2

In the embodiments described above, an edited image is stored when theprojector 20 is powered off (step S1194→step S1196 in FIG. 6/stepS2194→step S2196 in FIG. 13/step S3194→step S3196 in FIG. 20).Conversely, an edited image stored in the image storage unit 44 may bedeleted when the projector 20 is powered off. In this way, the contentof an edited image having been generated will not be revealed to anotherperson who powers on the projector again. The edited image is thussecurely protected.

(D3) Variation 3

In the embodiments described above, the projector 20 senses the infraredlight emitted from the infrared light pen P to recognize a user'sdrawing action, but the projector 20 does not necessarily sense infraredlight and may recognize a drawing action based on coordinate informationacquired from a mouse, a tablet, or any other pointing device connectedto the projector 20. A drawing action may still alternatively berecognized based on coordinate information acquired from an actionrecognition device that recognizes a user's action itself with a sensorand converts the recognized action into coordinate information. Stillalternatively, a user's drawing action may be recognized by using adedicated board that functions as the screen SCR. Specifically, considera case where a dedicated board having a touch panel capability isconnected to the projector 20. In this case, the drawing recognitionunit 24 may acquire coordinate information corresponding to a user'sdrawing action performed on the dedicated board, and the drawing imagegeneration unit 26 may generate a drawing image based on the acquiredcoordinate information. The same advantageous effects as those providedin the embodiments described above can therefore be provided.

(D4) Variation 4

In the embodiments described above, a wall-mounted, short-focal-lengthprojector is employed as the projector 20. A mobile projector mayalternatively be employed. In this case, since the relative positionalrelationship between the projector and the screen SCR may vary wheneverthey are installed, calibration by which the relative positionalrelationship is recognized is performed whenever the projector ispowered on, whereby a drawing action performed with the infrared lightpen P can be precisely recognized.

(D5) Variation 5

In the image projector system 10 in any of the embodiments describedabove, all the input/output devices connected to the input IF 50, theinput IF 74, the output IF 52, and the output IF 75 are not necessarilyconnected thereto. Further, devices other than the input devicesdescribed in the above embodiments may be connected to the projector 20.For example, an overhead camera, a mobile phone (including smartphone),and a variety of other input/output devices may be connected to theprojector 20.

The invention is not limited to the embodiments, examples, andvariations described above but can be implemented in a variety ofconfigurations to the extent that they do not depart from the substanceof the invention. For example, the technical features in theembodiments, examples, and variations corresponding to the technicalfeatures in the aspect described in Summary can be replaced or combinedas appropriate in such a way that part or all of the problems describedabove are solved or part or all of the advantageous effects describedabove are achieved. Further, any of the technical features can bedeleted as appropriate unless it is not described as essential portionsherein.

What is claimed is:
 1. An image projector device comprising: arecognition unit that recognizes a user's action; a control unit thatgenerates an image based on the user's action recognized by therecognition unit; a projection optical unit that projects and displaysthe image generated by the control unit; an image storage unit thatstores the image generated by the control unit; and a display controlunit that projects and displays, through the projection optical unit, adisplayed image containing a first area where the stored one or moreimages are displayed in user-selectable forms, and a second area where aselected one of the images is displayed.
 2. The image projector deviceaccording to claim 1, further comprising: an enclosure that accommodatesat least the projection optical unit and the control unit, wherein theenclosure accommodates an image processing unit that edits the selectedimage, the display control unit displays an image being edited in thesecond area, and the image storage unit stores the image having beenedited.
 3. The image projector device according to claim 1, furthercomprising: an enclosure that accommodates at least the projectionoptical unit and the control unit, wherein the enclosure accommodates anoutput control unit that outputs an image stored in the image storageunit out of the image projector device.
 4. The image projector deviceaccording to claim 3, wherein the output control unit outputs one ormore images selected by the user from the stored images out of the imageprojector device.
 5. The image projector device according to claim 3,wherein the output control unit outputs the stored images to at leastone of a nonvolatile memory, a mail server, and a printing device. 6.The image projector device according to claim 1, wherein the imagestorage unit deletes the stored image when the image projector device ispowered off.
 7. The image projector device according to claim 1, whereinthe image storage unit holds the stored image after the image projectordevice is powered off.
 8. A method of controlling an image projectordevice comprising: recognizes a user's action in conjunction with theprojector device; generates an image with a control unit based on therecognized user's action; projecting and displaying the image generatedby the control unit with a projection optical unit; storing the imagegenerated by the control unit in an image storage unit; and utilizing adisplay control unit to project and display, through the projectionoptical unit, a displayed image containing a first area where the storedone or more images are displayed in user-selectable forms, and a secondarea where a selected one of the images is displayed.
 9. The methodaccording to claim 8, wherein the projection optical unit, the controlunit and an image processing unit that edits the selected image areaccommodated in an enclosure, the method further comprising: displayingan image being edited in the second area with the display control unit;and storing the image having been edited in the image storage unit. 10.The method according to claim 8, wherein at least the projection opticalunit and the control unit are accommodated in an enclosure, and anoutput control unit that outputs an image stored in the image storageunit out of the image projector device is accommodated in the enclosure.11. The method according to claim 10, further comprising outputting oneor more images selected by the user from the stored images out of theimage projector device using the output control unit.
 12. The methodaccording to claim 10, further comprising outputting the stored imagesto at least one of a nonvolatile memory, a mail server, and a printingdevice using the output control unit.
 13. The method according to claim8, further comprising deleting the stored image when the image projectordevice is powered off using the image storage unit.
 14. The methodaccording to claim 8, further comprising holding the stored image afterthe image projector device is powered off using the image storage unit.